Neural Random-Access Machines

نویسندگان

  • Karol Kurach
  • Marcin Andrychowicz
  • Ilya Sutskever
چکیده

In this paper, we propose and investigate a new neural network architecture called Neural Random Access Machine. It can manipulate and dereference pointers to an external variable-size random-access memory. The model is trained from pure input-output examples using backpropagation. We evaluate the new model on a number of simple algorithmic tasks whose solutions require pointer manipulation and dereferencing. Our results show that the proposed model can learn to solve algorithmic tasks of such type and is capable of operating on simple data structures like linked-lists and binary trees. For easier tasks, the learned solutions generalize to sequences of arbitrary length. Moreover, memory access during inference can be done in a constant time under some assumptions.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Lie-Access Neural Turing Machines

External neural memory structures have recently become a popular tool for algorithmic deep learning (Graves et al., 2014; Weston et al., 2014). These models generally utilize differentiable versions of traditional discrete memory-access structures (random access, stacks, tapes) to provide the storage necessary for computational tasks. In this work, we argue that these neural memory systems lack...

متن کامل

THE "CAM-BRAIN" PROJECT The Evolutionary Engineering of a Billion Neuron Artificial Brain which Grows/Evolves at Electronic Speeds in a Cellular Automata Machine Part 1 : Fundamentals

This 2 part paper reports on the "CAM-Brain Project", which is an 8 year research project, beginning in 1993, at ATR labs in Kyoto, Japan, which intends to build/grow/evolve an artificial brain containing billions of artificial neurons. The essential idea behind CAM-Brain is to use cellular automata [Codd 1968] based neural networks which grow/evolve at electronic speeds inside cellular automat...

متن کامل

Performance evaluation of chain saw machines for dimensional stones using feasibility of neural network models

Prediction of the production rate of the cutting dimensional stone process is crucial, especially when chain saw machines are used. The cutting dimensional rock process is generally a complex issue with numerous effective factors including variable and unreliable conditions of the rocks and cutting machines. The Group Method of Data Handling (GMDH) type of neural network and Radial Basis Functi...

متن کامل

The Linear Time Hierarchy Theorems for Abstract State Machines and RAMs

We prove the Linear Time Hierarchy Theorems for random access machines and Gurevich abstract state machines. One long-term goal of this line or research is to prove lower bounds for natural linear time problems.

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • ERCIM News

دوره 2016  شماره 

صفحات  -

تاریخ انتشار 2016